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Abstract: We discuss the evolution of aspects of nonmonotonic reasoning towards 
the computational paradigm of answer-set programming (ASP). We give a general 
overview of the roots of ASP and follow up with the personal perspective on research 
developments that helped verbalize the main principles of ASP and differentiated it 
from the classical logic programming. 

1 Introduction — Answer-Set Programming Now 

Merely ten years since the term was first used and its meaning formally elaborated, 
answer-set programming has reached the status of a household name, at least in the 
logic programming and knowledge representation communities. In this paper, we 
present our personal perspective on influences and ideas — most of which can be 
traced back to research in knowledge representation, especially nonmonotonic reason- 
ing, logic programming with negation, constraint satisfaction and satisfiability testing 



that led to the two papers iMarek and Truszczvnskil ( 1999): N iemela (1999) mark- 



ing the beginning of answer-set programming as a computational paradigm. 

Answer-set programming {ASP, for short) is a paradigm for declarative program- 
ming aimed at solving search problems and their optimization variants. Speaking in- 
formally, in ASP a search problem is modeled as a theory in some language of logic. 
This representation is designed so that once appended with an encoding of a particular 
instance of the problem, it results in a theory whose models, under the semantics of 
the formalism, correspond to solutions t o the problem for this ins t ance. The paradigm 



was fi rst formulated in these terms by Mar ek and Truszczynski (1999) and Niemela 
(1999). 
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The ASP paradigm is most widely used with the formalism of logic program- 
ming without function symbols, with programs inte rpreted by the stable-model se- 
mantics introduced by Gelfond and Lifschitzl (1988). Sometimes the syntax of pro- 
grams is extended with the strong negation operator and disjunctions of literals are 
allowed in the heads of program rules. The semantics for such programs was also 
defined by iGelfond and Lifschitzl d 199 lb . They proposed to use the term answer sets 
for sets of literals, by which programs in the extended syntax were to be interpreted. 
Ten years after the answer-set semantics was introduced, answer sets lent their name 
to the budding paradigm. However, there is more to answer-set programming than 
logic programming with the stable-model and answer-set semantics. Answer-set pro- 
gramming languages rooted directly in first-order logic, extending it in some sim- 
ple intuitive ways to model definitions, have also been proposed over the years and 
have just matured to be computatio nally competitive with the original logic program- 
ming embodiments of the par adigm (IDenecken 1 1998c iDenecker and Ternovskal 12008 ; 
East and Truszczvnski, 2006). 



Unlike Prolog-like logic programming, ASP is fully declarative. Neither the order 
of rules in a program nor the order of literals in rules have any effect on the semantics 
and only negligible (if any) effect on the computation. All ASP formalisms come with 
the functionality to model definitions and, most importantly, inductive definitions, in 
intuitive and concise ways. Further, there is a growing body of works that start ad- 
dress i ng methods of modular program desig n (Dao-Tran, Eiter. Fink, and Krennwa llner 
2009; Janhunen, Oikarinen, Tompits, and Woltran, 2009) and program development 



and debugging dBrain and VosL 120051: iBrummaver and JarvisaloL 2010h . These fea- 
tures facilitate modeling problems in ASP, and make ASP an approach accessible to 
non-experts. 

Most importantly, though, ASP comes with fast software for processing answer- 
set programs. Processing of programs in ASP is most often done in two steps. The first 
step consists of grounding the program to its equivalent propositional version. In the 
second step, this propositional program is solved by a backtracking search algorithm 
that finds one or more of its answer sets (they represent solutions) or determines that 
no answer sets (solutions) exist. The current software tools employed in each step, 
commonly referred to as grounders and solvers, respectively, have already reached 
the level of performance that makes it possible to use them successfully with programs 
arising from problems of practical importance. 

This effectiveness of answer-set programming tools is a result of a long, sus- 
tained and systematic effort of a large segment of the Knowledge Representation 
community, and can be attributed to a handful of crucial ideas, some of them cre- 
atively adapted to ASP from other fields. Specifically, domain restriction was es- 
sential to help control t he size of ground programs. It was implemented in Iparse, 
the first ASP grounder INiemela and Simonsl (119961) . The well-founded semantics 



Van Gelder et al.1 (119911) inspired strong propagation methods implemented in the first 



full-fledged ASP solver smodels INiemela and Simons dl996h . Program completion 



Clark ( 1978) provided a bridge to satisfiability testing. For the class of tight programs 
Erdem and Lifschitzl (12003b . it allowed for a direct use of satisfiability testing software 



in ASP, t he idea first implem ented in an early version of the solver cmodels 1 . Loop 
formulas \Lm and Zh ao (2002) extended the connection to satisfiability testing to arbi- 



'http : / /www . cs . utexas . edu/users/tag/cmodels . html 
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trary p rograms. T hey gave rise to such succe ssful ASP solvers as assat Lin and Zhaol 
(2002) . pbmodels\lAu and Truszczvnski (2005) and later implementations of cmodels 
Lierler and Maratea (2004). Database techni ques for query optimization influenced 



the de sign of the grounder for the dlv system 2 (iLeone. Pfeifer. Faber. Eiter. Gottlob. Perri. and Scarcello , 
2006). Important advances of satisfiability testing including the data structure of 



watched literals, restarts, and conflict-clause learning were incorporated into the 
ASP solver clasp 1 , at present the front-runner among ASP solvers and the winner 
of one track of the 2009 SAT competition. Some of the credit for the advent of high- 
performance ASP tools is due to the initia tive to hold ASP grounder and solver con- 

tests. The two editions of the contest so fa r (Gebse rTLiu. Namasivavam. Neumann. Schaub. and Truszczvnskil 



2007; Denecker, Vennekens, Bond, Gebser, and Truszczvnski, 2009) focused on mod- 



eling and on solver performance, and introduced a necessary competitive element into 
the process. 

The modeling features of ASP and computational performance of ASP software 

find the most important reflection in a growing range of successful applications of 

ASP They include molecular biolog y (Gebser, Guziolowski. Ivanchev. Schaub. Siegel. Thiele. and Vebei , 



2010a: iGebser. Konig. Sc haub. Thiele. and Veber. 2010b), decision support system 



for space sh uttle controlle rs dBalduccini. Gelfond. and Nogueirail2006l). phvlogenetic 
system atics ( Erdem , 201 lb . a utomated music composition (iBoenn. Brain. Vos. and Fitchl 



2011 



2003 



) , product configuration dSoininen and NiemelS , 1998UTiihonen. Soininen. Niemela. and Sulonenl 

Finkel and O' Sullivan! 201 1 ) and repair of web-service workflows dFriedrich. Fugini. Mussi. Pernici. and T agni. 



20101) . 

And so, ASP is now a declarative programming paradigm built on top of a solid 
theoretical foundation, with features that facilitate its use in modeling, with software 
supporting effective computation, and with a growing list of successful applications 
to its credit. How did it all come about? This paper is an attempt to reconstruct our 
personal journey to ASP. 



2 Knowledge Representation Roots of Answer-Set Pro- 
gramming 

One of the key questions for knowledge representation is how to model commonsense 
knowledge and how to automate commonsense reasoning. The question does not seem 
particularly relevant to ASP understood, as it now commonly is, as a general purpose 
computational paradigm for solving search problems. But in fact, knowledge repre- 
sentation research was essential. First, it recognized and emphasized the importance 
of principled modeling of commonsense and domain knowledge. The impact of the 
modeling aspect of knowledge representation and reasoning is distinctly visible in the 
current implementations of ASP. They support high level programming that separates 
modeling problem specifications from problem instances, provide intuitive means to 
model aggregates, and offer direct means to model defaults and inductive definitions. 
Second, knowledge representation research, and especially nonmonotonic reasoning 
research, provided the theoretical basis for ASP formalisms: the answer-set semantics 
of programs can be traced back to the semantics of default logic and autoepistemic 

' www . dbai . tuwien .ac.at/proj/dlv/ 
-www . cs . uni -pots dam. de /clasp/ 
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logic, the semantics of the logic FO(ID) dDeneckei , 2000; iDenecker and T ernovska, 



2008) has it roots in the well-founded semantics of nonmonotonic provability opera- 
tors. 

In this section we discuss the development of those ideas in knowledge represen- 
tation that eventually took shape of answer-set programming. In their celebrated 1969 
paper, McCarthy and Hayes wrote 

[...] intelligence has two parts, which we shall call the epistemological 
and the heuristic. The epistemological part is the representation of the 
world in such a form that the solution of problems follows from the facts 
expressed in the representation. The heuristic part is the mechanism that 
on the basis of the information solves the problem and decides what to 
do. 

With this paragraph McCarthy and Hayes ushered knowledge representation and rea- 
soning into artificial intelligence and moved it to one of the most prominent positions 
in the field. Indeed, what they referred to as the epistemological part is now under- 
stood as knowledge representation, while the heuristic part has evolved into broadly 
understood automated reasoning — a search for proofs or models. 

The question how to do knowledge representation and reasoning quickly reached 
the forefront of artificial intelligence research. McCarthy suggested first-order logic 
as the formalism for knowledge representation. The reasons behind the proposal were 
quite appealing. First-order logic is "descriptively universal" and proved itself as the 
formal language of mathematics. Moreover, key reasoning tasks in first-order logic 
could be automated, assuming one adopted appropriate restrictions to escape semi- 
decidability of first-order logic in its general form. 

However, there is no free lunch and it turned out that first-order logic could not 
be just taken off the shelf and used for knowledge representation with no extra effort 
required. The problem is that domain knowledge is rarely complete. More often than 
not, information available to us has gaps. And the same is true for artificial agents 
we would like to function autonomously on our behalf. Reasoning with incomplete 
knowledge is inherently defeasible. Depending on how the world turns out to be (or 
depending on how the gaps in our knowledge are closed), some conclusions reached 
earlier may have to be withdrawn. The monotonicity of first-order logic consequence 
relation is at odds with the nonmonotonicity of defeasible reasoning and makes mod- 
eling defeasible reasoning in first-order logic difficult. 

To be effective even when available information is incomplete, humans often de- 
velop and use defaults, that is, rules that typically work but in some exceptional situa- 
tions should not be used. We are good at learning defaults and recognizing situations in 
which they should not be used. In everyday l ife, it is thanks to defaults that we are not 



bogged down in the qualification problem iMcCarthvl dl977l) . that is, normally we do 



not check that every possible precondition for an action holds before we take i t. And 
we naturally take advantage of the frame axiom iMcCarthv and Havesl ( 1969) when 



reasoning, that is, we take it that things remain as they are unless they are changed 
by an ac tion. Moreove r, we do so avoiding the difficulties posed by the ramification 



problem Finger] dl987l) . which is concerned with side effects of actions. However, 
first-order logic conspicuously lacks defaults in its syntactic repertoire nor does it pro- 
vide an obvious way to simulate them. It is not at all surprising, given that defaults 



Origins of ASP 



5 



have a defeasible flavor about them. Not being aware that a situation is "exceptional" 
one may apply a default but later be forced to withdraw the conclusion upon finding 
out the assumption of "non-exceptionality" was wrong. 

Yet another problem for the use of first-order logic in knowledge representation 
comes from the need to model definitions, most notably the inductive ones. The way 
humans represent definitions has an aspect of defeasibility that is related to the closed- 
world assumption. Indeed, we often define a concept by specifying all its known 
instantiations. We understand such a definition as meaning also that nothing else is 
an instance of the concept, even though we rarely if ever say it explicitly. But the 
main problem with definitions lies elsewhere. Definitions often are inductive and their 
correct meaning is captured by the notion of a least fixpoint. First-order logic cannot 
express the notion of a least fixpoint and so does not provide a way to specify inductive 
definitions. 

These problems did not go unrecognized and in late 1970s researchers were seek- 
ing ways to address them. Some proposals called for extensions of first-order logic 
by explicit means to model defaults while other argued that the language can stay the 
same but the semantics had to change. In 1980, the Artificial Intelligence Journal pub- 
lished a double issue dedicated to nonmonotonic reasoning, a form of reasoning based 
on but departin g in major ways fr om tha t in fir st-ord er logic. The issue contained 
three papers bv lMcCarthvl (l980), Reiter (1980), and McDermott and Dovle ( 1980) 
that launched the field of nonmonotonic reasoning. 

McCarthy's proposal to bend the language of first-order logic to the needs of 
knowledge representation was to adjust the semantics of first-order logic and to base 
the entailment re lation among sentences in first-order logic on minimal models only 
McCarthy ( 1980b . He called the resulting formalism circumscription and demon- 



strated how circums cription coul d be used in several settings where first-order logic 
failed to work well. iReiterl dl980l) extended the syntax of first-order logic by defaults, 
inference rules with exceptions, and described formally reasoning with defaults. Re- 
iter was predominantly interested in reasoning with normal defaults but his default 
logic was much more general. Finally, McDermott and Doyle proposed a logic based 
on the language of modal logic which, as they suggested, was also an attempt to 
model reasoning with defaults. Th is last paper was f ound to suffer from minor tech- 
nical problems. Two years later, McD ermott! (1 1982b published another paper which 
corrected and extended the earlier one. 

These three papers demonstrated that shortcomings of first-order logic in model- 
ing incomplete knowledge and supporting reasoning from these representations could 
be addressed without giving up on the logic entirely but by adjusting it. They sparked 
a flurry of research activity directed at understanding and formalizing nonmonotonic 
reasoning. One of the most im portant and lasting o utcomes of those efforts was the au- 
toepistemic logic proposed bv lMoord d 1984 1 1985). Papers by Moore can be regarded 
as closing the first phase of the nonmonotonic reasoning as a field of study. 

Identifying nonmonotonic reasoning as a phenomenon deserving an in-depth study 
was a major milestone in logic, philosophy and artificial intelligence. The prospect of 
understanding and automating reasoning with incomplete information, of the type we 
humans are so good at, excited these research communities and attracted many re- 
searchers to the field. Accordingly, the first 10-12 years of nonmonotonic reasoning 
research brought many fundamental results and established solid theoretical founda- 
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tions for circumscription McCarthy (1980) : iLif schitzl (1 1 9 8 8b , default logic dReiter and Criscuolol 
198lt lHanks and McDermottlll98dlMarek and Troszczvnskilll989t|Pearllll990l). au- 



toepistemic log ic ( Mooret [l985l;lNiemelal.ll988l : lMarek and Truszczvnskil.ll 99 ll; Shvartsl 
1990; Schwarz, 1991) and modal nonmonotonic logics in the style of McDermott and 



Doyle dMarek. Shvarts. and Truszczynski , 1993 ; Schwarzl 1992 ; Schwarz and Truszczynski , 



1992). Researchers made progress in clarifying the relationship between these for- 
malisms Konolige ( 1988, 1989); iMarek and Truszczyn ski ( 1989b); Bidoit and Froidevauxl 
(1991); iTruszczvriskil (1199 II) . Computational aspects received much attention, too- 
First c o mplexity results appeared in late 1980s and early 1990s|C adoli and L enzerinil 
dl990l): Marek and Truszczvriskil (fl99ll) : iKautz and Selmanl dl989b : iGottlobl Jl992h : 
IStillmanl (11992b and early, still naive at that time, implementations of aut omated rea- 



soning with nonmonotonic logics were deve l oped around the same time lEtherington 



( 1987); Niemela and T uominen ( 19861 ll987h : lGinsberg| (fr989). Several research mono- 
graphs were published in late 1980s and early 1990s systematizing that phase of 
nonmonotonic r easoning research and making it accessible to o utside communities 



Besnardl (11989); Brewka (1991); M arek and Truszczyn ski ( 1993). 



Expectations brought up by the advent of nonmonotonic reasoning formalisms 
were high. It was thought that nonmonotonic logics would facilitate concise and elab- 
oration tolerant representations of knowledge, and that through the use of defeasible 
inference rules like defaults it would support fast reasoning. However, around the 
time of the first Knowledge Representation and Reasoning Conference, KR 1989 in 
Toronto, concerns stalled to surface in discussions and papers. 

First, there was the issue of multiple belief sets, depending on the logic used rep- 
resented as extensions or expansions. A prevalent interpretation of the problem was 
that multiple belief sets provided the basis for skeptical and brave modes of reasoning. 
Skeptical reasoning meant considering as consequences a reasoner was sanctioned to 
draw only those formulas that were in every belief set. Brave reasoning required a 
non-deterministic commitment to one of the possible belief sets with all its elements 
becoming consequences of the underlying theory (in the nonmonotonic logic at hand). 
The first approach was easy to understand and accept at the intuitive level. But as a 
reasoning mechanism it was rather weak as in general it supported few non-trivial in- 
ferences. The second approach was underspecified — it provided no guidelines on 
how to select a belief set, and it was not at all obvious how if at all humans perform 
such a selection. Both skeptical and brave reasoning suffered from the fact that there 
were no practical problems lying around that could offer some direction as to how to 
proceed with any of these two approaches. 

Second, none of the main nonmonotonic logics seemed to provide a good for- 
malization of the notion of a default or of a defeasible consequence relation. This 
was quite a surprising and in the same time worrisome observation. Nonmonotonic 
reasoning brought attention to the concept of default and soon researc hers raised 
the question of how to reason about defaults rather than with defau lts (|Pear]|.ll990t 
Kraus. Lehmann. an d Magidor, 1990; Lehmann and Magidor, 1992). A somewhat 



different version of the same question asked about defeasible consequence relations, 
whether they can be characterized in terms of intui t ively a cceptable axioms , and 
whether they have semantic characterizations Gabbav ( 198 9); Makinson ( 19891) . De- 
spite the success of circumscription, default and autoepistemic logics in addressing 
several problems of knowledge representation, it was not clear if or how they could 
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contribute to the questions above. In fact, it still remains an open problem whether 
any deep connection between these logics and the studies of abstract nonmonotonic 
inference relations exists. 

Next, the complexity results obtained at about same time Marek and Truszczyhski 
(|l99ll):lEiter and Gottlobl dl993ah : lGottlor3 (Il992h : lstillmanl dl992h : lEiter and Gottlob 
(I1993bl 1 1995D were viewed as negative. They dispelled any hope of higher computa- 
tional efficiency of nonmonotonic reasoning. Even under the restriction to the prepo- 
sitional case, basic reasoning tasks turned out to be as complex as and in some cases 
even more complex (assuming polynomial hierarchy does not collapse) than reasoning 
in propositional logic. Even more discouraging results were obtained for the general 
language. 

Finally, the questions of applications and implementations was becoming more 
and more urgent. There were no practical artificial intelligence applications under 
development at that time that required nonmonotonic reasoning. Nonmonotonic log- 
ics continued to be extensively studied and discussed at AI and KR conferences, but 
the belief that they can have practical impact was diminishing. There was a growing 
feeling that they might amount to not much more but a theoretical exercise. Complex- 
ity results notwithstanding, the ultimate test of whether an approach is practical can 
only come from experiments, as the worst-case complexity is one thing but real life 
is another. But there was little work on implementations and one of the main reasons 
was lack of test cases whose hardness one could control. Researchers continued to 
analyze "by hand" small examples arguing about correctness of their default or au- 
toepistemic logic representations. These toy examples were appropriate for the task 
of understanding basic reasoning patterns. But they were simply too easy to provide 
any meaningful insights into automated reasoning algorithms and their performance. 

And so the early 1990s saw a growing sentiment that in order to prove itself, 
to make any lasting impact on the theory and practice of knowledge representation 
and, more generally, on artificial intelligence, practical and efficient systems for non- 
monotonic reasoning had to be developed and their usefulness in a broad range of 
applications demonstrated. Despite of all the doom and gloom of that time, there were 
reasons for optimism, too. The theoretical understanding of nonmonotonic logics 
reached the level when development of sophisticated computational methods became 
possible. Complexity results were disappointing but the community recognized that 
they concerned the worst case setting only. Human experience tells us that there are 
good reasons to think that real life does not give rise to worst-case instances too often, 
in fact, that it rarely does. Thus, through experiments and the focus on reasoning with 
structured theories one could hope to obtain efficiency sufficient for practical applica- 
tions. Moreover, it was highly likely that once implemented systems started showing 
up, they would excite the community, demonstrate the potential of nonmonotonic log- 
ics, and spawn competition which would result in improvements of algorithms and 
performance advances. 

It is interesting to note that many of the objections and criticisms aimed at non- 
monotonic reasoning were instrumental in helping to identify key aspects of answer- 
set programming. Default logic did not provide an acceptable formalizati on of reason- 

ing ab o ut defaults but inspired t he answer-se t semantics of logic programs lBidoit and Froidevaux 
dl987l) : lGelfond and Lifschita dl988l Il99 lb and helped to solve a long-standing prob- 
lem of how to interpret negation in logic programming. Answer-set programming, 
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which adopted the syntax of logic programs, as well as the answer-set semantics, can 
be regarded as an implementation of a significant fragment of default logic. The lack 
of obvious test cases for experimentation with implementations forced researchers to 
seek them outside of artificial intelligence and led them to the area of graph prob- 
lems. This experience showed that the phenomenon of multiple belief sets can be 
turned from a bug to a feature, when researchers realized that it allows one to model 
arbitrary search problems, with extensions, expa nsions or answer sets, depending 
on the logic used, represe nting problem solutions (Cadoli . Eiter. and Gottlobi ri997: 



Marek and Remmel, 2003). 



However important, knowledge representation was not the only source of inspira- 
tion for ASP. Influences of research in several other areas of computer science, such as 
databases, logic programming and satisfiability, are also easily identifiable and must 
be mentioned, if only briefly. One of the key themes in research in logic programming 
in the 1970s and 1980s was the quest for the meaning of the negation operator. Stan- 
dard logic programming is built around the idea of a single intended Herbrand model. 
A program represents the declarative knowledge about the domain of a problem to 
solve. Some elements of the model, more accurately, ground terms the model deter- 
mines, represent solutions to the problem. All works well for Horn programs, with the 
least Herbrand model of a Horn program as the natural choice for the intended model. 
But the negation operator, being ingrained in the way humans describe knowledge, 
cannot be avoided. The logic programming community recognized this and the nega- 
tion was an element of Prolog, an implementation of logic programming, right from 
the very beginning. And so, the question arose for a declarative (as opposed to the 
procedural) account of its semantics. 

Subsequent studies identified a non-classical nature of the negation operator. This 
nonmonotonic aspect of the negation operator in logic programming was also a com- 
plicating factor in the effort to find a single intended model of logic programs with 
negation. It became clear that to succeed one either had to restrict the class of pro- 
grams or to move to the three-valued settin gs. The first line of researc h resulted in 
an imp ortant class of strati fied programs dApt. Blair, and Walken , 1 1988b . the second 
one led Fitting (1 1985b andlKunenl j[1987l) to the Kripke-Kleene model and, later on, 
Van Gelder. Ross, and Schlip? (11991b to the well-founded model. 



In the hindsight, the connection to knowledge representation and nonmonotonic 
reasoning should have been quite evident. However, the knowledge representation 
and logic programmi ng communities had li t tle ov erlap at the time. And so it was not 
before the work by Bido it and Froidevaux ( 1987 ) and Gelfond ( 1987b that the con- 
nection was made explicit and then exploited. That work demonstrated that intuitive 
constraints on an intended model cannot be reconciled with the requirement of its 
uniqueness. In other words, with negation in the syntax, we must accept the reality 
of multiple intended models. The connection between logic programming and knowl- 
edge representation, especially, default and autoepistemic logics was important. On 
the one hand, it showed that logic programming can provide syntax for an interest- 
ing non-trivial fragment of these logics, and drew attention of researchers attempting 
implementations of nonmonotonic reasoning systems. On the other hand, it led to 
the notion of a stable model of a logic program with negation. It also reinforced the 
importance of the key question how to adapt the phenomenon of multiple intended 
models for problems solving. 
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The work in databases provided a link between query languages and logic pro- 
gramming. One of the outcomes of this work was DATALOG, a fragment of logic 
programming without function symbols, proposed as a query language. The database 
research resulted in important theoretical studies concerning co mplexity, expressiv e 



power and connection of DATALOG to the SQL query language (Cadoli et al., 1997) 



DATALOG was implemented, for instance as a part of DB2 database management 
system. DATALOG introduced an important distinction between extensional and in- 
tentional database components. Extensional database is the collection of tables that are 
stored in the database, the corresponding relation names known as extensional pred- 
icate symbols. The intensional database is a collection of intentional tables defined 
by DATALOG queries. In time this distinction was adopted by answer-set program- 
ming as a way to separate problem specification from data. The database community 
also considered extensions of DATALOG with the negation connective. Because of 
the semantics of the resulting language, multiplicity of answers in DATALOG^ was 
a problem, as it was in a more general setting of arbitrary programs with negation. 
Therefore, DATALOG^ never turned into a practical database query language (al- 
though, its stratified version could very well be used to this end). However, it was 
certainly an interesting fragment of logic programming. And even though its expres- 
sive power was much lower than that of general programs, 4 there was hope that fast 
tools to process DATALOG^ can be developed. Jumping ahead, we note here that 
it was DATALOG^ that was eventually adopted as the basic language of answer-set 
programming. 



3 Towards Answer-Set Programming at the University 
of Kentucky 

Having outlined some of the key ideas behind the emergence of answer-set program- 
ming, we now move on to a more personal account of research ideas that eventually 
resulted in the formulation of the answer-set programming paradigm. In this sec- 
tion, Victor Marek and Mirek Truszczynski, discuss the evolution of their understand- 
ing of nonmonotonic logics and how they could be used for computation that led to 
their paper Stable logic program ming — an alternative logic programming paradigm 
Marek and Truszczvhski dl999h . A closely intertwined story of Ilkka Niemela, fol- 



lows in the subsequent section. As the two accounts are strongly personal and neces- 
sarily quite subjective, for the most part they are given in the first person. And so, in 
this section "we" and us refers to Victor and Mirek, just as "I" in the next one to Ilkka. 

In mid 1980s, one of us, Victor, started to study nonmonotonic logics following a 
suggestion from Witold Lipski, his former Ph.D. student and close collaborator. Lip- 
ski dr ew Victor's a t tentio n to Reiter's papers on closed-world assumption and default 
logic iReitei ( 1978 , 1980i) . In 1984, Victor attended the first Nonmonotonic Reason- 



ing Workshop at Mohonk, NY, and came back convinced about the importance of 
problems that were discussed there. In the following year, he attracted Mirek to the 
program of the study of mathematical foundations of nonmonotonic reasoning. 



4 It has to be noted though that the expressive power of general programs with function symb ols and 
negation goes well beyond what could be accepted as computable under all reasonable semantics iSchfimt 
ll995t lMarek. Nero de. and Remmell[l994ll . 
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In 1988 Michael Gelfond visited us in L exington and in his presentation talked 
about the use of autoepistemic logic Moore d 1985b to provide a semantics to logic 
programs. At the time we were already studying autoepistemic logic, inspired by 
talks Victor attended at Moho nk and by Moo re's paper on autoepistemic logic in the 
Artificial Intelligence Journal Moore ( 19851). We kne w by then that stable sets of 
formulas of modal logic, introduced by 



Stalnaker ( 1980) and shown to be essential for 



autoepistemic l ogic, can be co nstructed by an iterated inductive definition from their 
modal-free part Marek (1989). We also reali zed the importan ce of a simple normal 
form for autoepistemic theories introduced by iKonoligd d 1 988ft . 

Thus, we were excited to see that logic programs can be unders t ood as some simple 
autoepistemic theories thanks to Gelfond's interpretation lGelfondld 19871) . Soon there- 
after, we also realized that logic programs could be interpreted also as default logic 
theories and that the meaning of logic programs induced on the m by default logic ex- 
tension s is the same as that induced by autoepistemic expansions lMarek and Truszczynski 
(1989b). It is import ant to note that default logic w as first used to assign the meaning 
to logic programs by iBidoit and Froidevauxl d 19871) . but we did not know about their 
work at the time. Bidoit and Froidevaux effectively defined the stable model seman- 
tics for logic programs. They did so indirectly and with explicit references to default 
extensions. The direct definition of stable mo dels in logic programming t erms came 
about one year later in the celebrated paper by Gelfond and Lifschitz ( 1988b . 

What became apparent to us soon after Gelfond's visit was that despite both au- 
toepistemic expansions and default extensions inducing the same semantics on logic 
programs, it was just serendipidity and not the result of the inherent equivalence of 
the two logics. In fact, we noticed that there was a deep mismatch between Moore's 
autoepistemic logic with the semantics of expansions and Reiter's default logic with 
the semantics of extensions. In the same time, we discovered a form of default logic, 
to be more precise, an alternative semantics of def ault logic, which was the perfec t 
match for that of expansions for autoepistemic logic Marek and Truszczvnskil (1989). 
This research culminated about 15 years later with a paper we co-authored with Marc 
Denecker that provid ed a definitive account of the relationship between default and au- 
toepistemic logics dDenecker. Marek. and Truszczynski , 12003 ) and resolved problem s 
and flaws of an earlier attempt at explaining the relationship due to Konolige (1988). 
Another paper in this volume dDenecker. Marek. and Truszczvnskil 1201 lb discusses 
the informal basis for that work and summarizes all the key results. 

The relationship between default and autoepistemic logic was of only marginal 
importance for the later emergence of answer-set programming. But another result 
inspired by Gelfond's visit turned out to be essential. In our study of autoepistemic 
logic we wanted to establish the complexity of the existence of expansions. We ob- 
tained the result by showing that the problem of the existence of a stable model of a 
logic program is NP-complete and, by doing so, we obtained the same complexity for 
the problem of the existence of expansions of autoepistemic theories of some simple 
form but still rich enough to c apture logic programs under Gelfond's interpretation 



Marek and Truszczynski ( 1991). 



The result for autoepistemic logic did not turn out to be particularly significant 
as the class of autoepistemic theori es it pertained to was narrow. And it was soon 
supplanted by a general result due to Gottlob) dl992h . who proved the existence of the 
expansions problem to be £.f -complete. But it was an entirely different matter with 
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the complexity result concerning the existence of stable models of programs! 

First, our proof reduced a combinatorial problem, that of the existence of a kernel 
in a directed graph, to the existence of stable model of a suitably defined program. 
This was a strong indication that stable semantics may, in principle, lead to a general 
purpose formalism for solving combinatorial and, more generally, search problems. 
Of course we did not fully realize it at the time. Second, it was quite clear to us, 
especially after the first KR conference in Toronto in May 1989 that the success of 
nonmonotonic logics can come only with implementations. Many participants of the 
conference (we recall David Poole and Matt Ginsberg being especially vocal) called 
for working systems. Since by then we understood the complexity of stable-model 
computation, we asked two University of Kentucky students Elizabeth and Eric Free- 
man to design and implement an algorithm to compute stable models of propositional 
programs. They succeeded albeit with limits — the implementation could process 
programs with about 20 variables only. Still, theirs was most likely the first working 
implementation of stable-model computation. Unfortunately, with the M.S. degrees 
under their belts, Eric and Elizabeth left the University of Kentucky. 

For about three years after this first dab into implementing reasoning systems 
based on a nonmonotonic logic, our attention was focused on more theoretical studies 
and on the work on a monograph on mathematical foundations of nonmonotonic rea- 
soning based on the paradigm of context-dependent reasoning. However, the matter 
of implementations had constantly been on the backs of our minds and in 1992 we 
decided to give the matter another try. As we felt we understood default logic well 
and as it was commonly viewed as the nonmonotonic logic of the future, in 1992 we 
started the project, Default Reasoning System DeReS. We aimed at implementing rea- 
soning in the unrestricted language of propositional default logic. We also started a 
side project to DeReS, the TheoryBase project, aimed at developing a software system 
generating default theories to be used for testing DeReS. The time was right as two 
promising students, Pawel Cholewinski and Artur Mikitiuk, joined the University of 
Kentucky to pursue doctorate degrees in computer science. 

As is common in such circumstances, we were looking for a sponsor of this re- 
search and found one in the US Army Research Office (US ARO), which was willing 
to support this work. A colleague of ours, Jurek Jaromczyk, also at the University 
of Kentucky, coined the term DeReS, a pun on an old polish word "deresz" presently 
rarely used and meaning a stallion, quite appropriate for the project to be conducted in 
Lexington, "the world capital of the horse." In the proposal to US ARO we promised 
to investigate basic reasoning problems of default logic: 

1 . Computing of extensions 

2. Skeptical reasoning with default theories — testing if a formula belongs to all 
extensions of an input default theory 

3. Brave reasoning with default theories — testing if a formula belongs to some 
extension of an input default theory. 

The basic computational device was backtracking search for a basis of an extension 
of a finite default theory (D, W). This was based on two observations due to Reiter: 
that while default extensions of a finite default theory are infinite, they are finitely 
generated; and that the generators are all formulas of W and the consequent formulas 
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of som e defaults from D. We also employed ideas suc h as relaxed stratification of 



defaults lCholew inski ( 1995); Lifschitz and Turner! (1 19941) for pruning the search space 



and relevance graphs for simplifying provability. 

We also thought it was important to have the nonmonotonic reasoning community 
accept the challenge of developing implementations of automated nonmonotonic rea- 
soning. Our proposal to US ARO contained a request for funding of a retreat dedicated 
to knowledge representation, nonmonotonic reasoning and logic programming. The 
key goals for the retreat were: 

1 . To stimulate applications of nonmonotonic formalisms and implementations of 
automated reasoning systems based on nonmonotonic logics 

2. To promote the project to create a public domain library of benchmark problems 
in nonmonotonic reasoning. 

We held the workshop in Shakertown, KY, in October 1994. Over 30 leading re- 
searchers in nonmonotonic reasoning participated in talks and we presented there early 
prototypes of DeReS and TheoryBase. Importantly, we heard then for the first time 
from Ilkka Niemela about the work on systems to perform nonmonotonic reasoning 
in the language of logic programs in his group at the Helsinki University of Technol- 
ogy. The meeting helped to elevate the importance of implementations of nonmono- 
tonic reasoning systems and their applications. It evidenced first advances in the area 
of implementations, as well as in the area of benchmarks, essential as so far most 
problems considered as benchmarks were toy problems such as "Tweety" and "Nixon 
Diamond." 

The DeReS system was not designed with any specific applications in mind. At 
the time we believed that, since default logic could model several aspects of com- 
monsense reasoning, once DeReS became available, many artificial intelligence and 
knowledge representation researchers would use it in their work. And we simply 
regarded broadly understood knowledge representation problems as the main applica- 
tion area for DeReS. 

Working on DeReS immediately brought up to our attention the question of test- 
ing and performance evaluation. In the summer of 1988, Mirek attended a meeting 
on combinatorics where Donald Knuth talked about the problem of testing graph al- 
gorithms and his proposal how to do it right. Knuth was of the opinion that testing 
algorithms on randomly generated graphs is insufficient and, in fact, often irrelevant. 
Graphs arising in real-life settings rarely resemble graphs generated at random from 
some probabilistic model. To address the problem, Knuth developed a software sys- 
tem, Stanford GraphBase, providing a mechanism for creating collections of graphs 
that could be then used in projects developing graph algorithms. Graphs produced by 
the Stanford GraphBase were mostly generated from real-life objects such as maps, 
dictionaries, novels and images. Some were based on rather obscure sources such 
as sporting events in Australia. The documentation was superb (the book by Knuth 
on the Stanford GraphBase is still available). The Stanford GraphBase was free and 
its use was not restricted. From our perspective, two aspects were essential. First, 
the Stanford GraphBase provided a unique identifier to every graph it created and so 
experiments could be described in a way allowing others to repeat them literally and 
perform comparisons on identical sets of graphs. Second, the Stanford GraphBase 
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supported creating families of examples similar but increasing in size, thus allowing 
to test scalability of algorithms being developed. 

In retrospect, the moment we started talking about testing our implementations of 
default logic was the defining moment on our path towards the answer-set program- 
ming paradigm. Based on our complexity result concerning the existence of stable 
models and its implication for default logic, we knew that all NP-complete graph 
problems could be reduced to the problem of the existence of extensions. The reduc- 
tions expressed instances of graph problems as default theories. Thus, in order to get 
a family of default theories, similar but growing in size, we needed to select an NP- 
complete problem on graphs (say, the hamiltonian cycle problem), generate a family 
of graphs, and generate for each graph in the family the corresponding default the- 
ory. These theories could be used to test algorithms for computing extensions. This 
realization gave rise to the TheoryBase, a software system generating default theories 
based on reductions of graph problems to the existence of the extension problem and 
developed on top of the Stanford GraphBase, which served as the source of graphs. 
The TheoryBase provided default theories based on six well-known graph problems: 
the existence of fc-colorings, Hamiltonian cycles, kernels, independent sets of size at 
least k, and vertex covers of size at most k. As the Stanford GraphBase provided an 
unlimited supply of graphs, the TheoryBase offered an unlimited supply of default 
theories. 

We will recall here the TheoryBase encoding of the existence of a /c-coloring prob- 
lem as it shows that already then some fundamental aspects of the methodology of rep- 
resenting search problems as default theories started to emerge. Let G = (V, E) be an 
undirected graph with the set of vertices V = {vi ,...,«„}. Let C = {c\ , . . . , Ck} be 
a set of colors. To express the property that vertex v is colored with c, we introduced 
propositional atoms clrd(v, c). For each vertex Vi,i — 1, . . . , n, and for each color 
Cj, j = 1, . . . , k, we defined the default rule 



color(vi, Cj) = 



: ->clr(v i ,c 1 ), -iclr(vj,Cj-i),-<clr(vi,Cj + i), ->clr(vi,c k ) 
clr(vi,Cj) 



The set of default rules {color(vi,Cj) : j = 1, . . . , k} models a constraint that vertex 
Vi obtains exactly one color. The default theory (Do, 0), where 

D a = {color(vi,Cj) : i — 1, . . . , n, j = 1, . . . , k}, 

has k n extensions corresponding to all possible colorings (not necessarily proper) of 
the vertices of G. Thus, the default theory (Do, 0) defines the basic space of objects 
within which we need to search for solutions. In the present-day answer-set program- 
ming implementations choice or cardinality rules, which offer much more concise 
representations, are used for that purpose. Next, our TheoryBase encoding imposed 
constraints to eliminate those colorings that are not proper. To this end, we used ad- 
ditional default rules, which we called killing defaults, and which now are typically 
modeled by logic program rules with the empty head. To describe them we used a 
new propositional variable F and defined 

,. . clrd(x.c) A clrd(y,c) : ~^F 
local(e,c) = , 
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for each edge e = (x, y) of the graph and for each color c. Each default local(e, c) 
"kills" all color assignments which give color c to both ends of edge e. It is easy to 
check (and it also follows from now well-known more general results) that defaults 
of the form local(e, c) "kill" all non-proper colorings and leave precisely those that 
are proper. This two-step modeling methodology, in which we first define the space of 
objects that contains all solutions, and then impose constraints to weed away those that 
fail some problem specifications, constitutes the main way by which search problems 
are modeled in ASP. 

The key lesson for us from the TheoryBase project was that combinatorial prob- 
lems can be represented as default theories and that constructing these representations 
is easy. It was then for the first time that we sensed that programs finding exten- 
sions of default theories could be used as general purpose problem solving tools. It 
also lead us, in our internal discussions to thinking about "second-order" flavor of 
default logic, given the way it was used for computation. Indeed, in all theories 
we developed for the TheoryBase, extensions rather than their single elements rep- 
resented solutions. In other words, the main reasoning task did not seem to be that 
of skeptical or brave reasoning (does a formula follow skeptically or bravely from 
a default theory) but computing entire extensions. We talked about this second- 
order flavor when presenting our paper on DeReS at the KR conference in 1996 
( Cholewinski. Marek. and TruszczvnskiL 19961) . At that time, we knew we were clos- 
ing in on a new declarative problem-solving paradigm based on nonmonotonic logics. 

A problem for us was, however, a fairly poor performance of DeReS. The default 
extensions are closed under consequence. This means that processing of default the- 
ories requires testing provability of prerequisites and justifications of defaults. This 
turned out to be a major problem affecting the processing time of our impleme nta- 
tions. It is not s urprising at all in view of the complexity results of iGotflobld 1992b and 
Still manldl992b . Specifically, existence of extensions is a -complete problem. 

There is, of course, an easy case of provability when all formulas in a default 
theory are conjunctions of literals only. Now the problem with the provability of 
premises disappears. However, DeReS organized its search for solutions by looking 
for sets of generating defaults, inheriting this approach from the case of general default 
theories, rather than for literals generating an extension. And that was still a problem. 
There are typically many more rules in a default theory than atoms in the language. 

At the International Joint Conference and Symposium on Logic Programming in 
1996, Ilkk a and his student Patrik Sim ons presented the first report on their smod- 
els system iNiemela and Simons (1996). But it seems fair to say that only a similar 
presentation and a demo Ilkka gave at the Logic Programming and Non-Monotonic 
Reasoning Conference in 1997, in Dagstuhl, made the community really take notice. 
The Iparse/smodels constituted a major conceptual breakthrough and handled nicely 
all the traps DeReS did not avoid. First, Iparse/smodels focused on the right fragment 
of default logic, logic programming with the stable-model semantics. Next, it orga- 
nized search for a stable model by looking for atoms that form it. Finally, it supported 
programs with variables and separated, as was the standard in logic programming and 
databases, a program (a problem specification) from an extensional database (an in- 
stance of the problem). 

The work by Niemela had us focus our thinking about nonmonotonic logics as 
computational devices on the narrower but all-important case of logic programs. We 
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formulated our ideas about the second-order flavor of problem solving with nonmono- 
tonic logics and contrasted them with the traditional Prolog- style interpretation of 
logic programming. We stated our initial thoughts on the methodology of problem 
solving that exploited our ideas of modeling combinatorial problems that we used in 
the TheoryBase project, as well as the notion of program-data separation that came 
from the database community and was, as we just mentioned, already used in our field 
by Niemela. These ideas formed the backbone of our paper o n an alternative way logic 
progra mming could be used for solving search problems IMarek and Truszczvnski 
( 1993). 



4 Towards Answer-Set Programming at the Helsinki 
University of Technology 

In this section Ilkka Niemela discusses the developments at the Helsinki University 
of Technology that led to the paper L ogic Prog r ams w ith Stable Model Semantics as 
a Constraint Programming Paradigm iNiemela dl999h . Similarly as in the previous 
section, the account is very personal and quite subjective. Hence, in this section "I" 
refers to Ilkka. 

I got exposed to nonmonotonic reasoning when I joined the group of Professor 
Leo Ojala at the Helsinki University of Technology in 1985. The group was studying 
specification and verification techniques of distributed systems. One of the themes 
was specification of distributed systems using modal, in particular, temporal and dy- 
namic logics. The group had got interested in the solutions of the frame problem 
based on nonmonotonic logics when looking for compact and computationally effi- 
cient logic -based specification techniques for distributed systems. My role as a new 
research assistant in the group was to examine autoepistemic logic by Moore, non- 
monotonic modal logics by McDermott and Doyle, and default logic by Reiter from 
this perspective. 

There was a need for tool support and together with a doctoral student Heikki 
Tuominen we developed a system that we called the Helsinki Logic Machine, "an 
experimental reasoning system designed to provide assistance neede d for applica- 
tion oriented research in logic" ( Nie melj and Tuominenl 1986 , 1987 ). The system 
included tools for theorem proving, model synthesis, model checking, formula ma- 
nipulation for modal, temporal, epistemic, deontic, dynamic, and nonmonotonic log- 
ics. It was written in Quintus Prolog and contained implementations, for instance, for 
Reiter's default logic, McDermott and Doyle style nonmonotonic modal logic, and 
autoe pistemic logi c in the propositional case based on the literature a nd some own 
work dEtheringtoni Il987t iMcDermott and Dovlel Il980l: iNiemelaL Il988l) . While non- 
monotonic reasoning was a side-track in the Helsinki Logic Machine, it seems that it 
was one of the earliest working nonmonotonic reasoning systems although we were 
not very well aware of this at the time. 

The work and, in particular, the difficulties in developing efficient tools led me to 
further investigations t o gain a deeper understanding of algorithmic issues an d related 
complexity questions dNiemelal fl 9881; iNiemelE 1 1 988i fl 990t iNiemelil 1 1 992h . Similar 
questions were studied by others and in the early 90s results explaining the algorith- 
mic difficulties started emerging. These results showed that key reasoning tasks in 
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major nonmonotonic logics are complete for the s e cond leve l of the polynom i al hier - 
archv lCadoli and Lenzeriiiil d 1 990l) : Ic-otflobl d 1 992b ; Istillmanl dl992h : (Niemelj d 1 992b . 
This indicated that these nonmonotonic logics have two orthogonal sources of com- 
plexity that we called classical reasoning and conflict resolution. Orthogonality means 
that even if we assume that classical reasoning can be done efficiently, nonmonotonic 
reasoning still remains NP-hard (unless the polynomial hierarchy collapses). 

These results made me to focus more on conflict resolution to develop techniques 
for pruning the search space of potential expansions/extensions. One approach was to 
develop compact characterizations of expansions/extensions capturing their key ingre- 
dients. For autoepistemic logic I developed such a characterization based on the idea 
that expansions can be captured in terms of the modal subformulas in the premises and 
classic al reasoning a nd exploited the idea in a decision procedure for autoepistemic 
logic iNieme Together with Jussi Rintanen we also showed that if one lim- 

its the theory in such a way that conflict resolution is easy by requiring stratification, 
then efficie nt reasoning is possible by fur ther restrictions affecting the other source of 
complexitv lNiemela and Rintanenl dl992h . 

The characterization based on modal subformulas generalizes also to default logic 
where extensions can be captured using justifications in the rules and leads to an inter- 
esting way of organizing the search for expansions/ex tensions as a binary s earch tree 
very similar to that in the DPLL algorithm for SAT lNiemelj dl994l fl995h . Further 
pruning techniques can be integrated to cut substantial parts of the potential search 
space for expansions/extensions and exploit, for instance, stratified parts of the rule 
set. My initial but very unsystematic experimentation gave promising results. 

In 1994 encouraged and challenged by the Shakertown Workshop organized by 
Victor and Mirek, I decided to restrict to a simple subclass of default theories, that is, 
logic programs with the stable model semantics. For this subclass classical reasoning 
is essentially limited to Horn clauses and can be done e fficiently in linear time usin g 
techniques proposed by Dowling and Gallier in the 1980s lDowling and Gal lier (1984). 
I had no particular application in mind. The goal was to study whether the conflict 
resolution techniques I had developed for autoepistemic and default logic would scale 
up so that it would be possible to handle very large sets of rules which meant at that 
time thousands or even tens of thousands of rules. 

At that time Patrik Simons joined my group and started working on a C++ imple- 
mentation of the general algorithm tailored to logic programs. Patrik had excellent in- 
sights into the ke y implementation issues from very early on and the first version was 
released in 1995 iNiemela and Simonsl (11995b . The C++ implementation was called 
smodels and it computed stable models for ground normal programs. It gave sur- 
prising good results immediately and could handle programs with a few thousand 
ground rules. Challenge benchmarks were combinatorial problems, mainly colorabil- 
ity and Hamiltonian cycles, an idea that I learnt from Mirek and Victor in Shakertown. 
For such hard problems the performance of smodels was substant ially better than 
state-of-the-art tools such as the SLG svstem lChen and Warrenld 1996b . 

When developing benchmarks for evaluating novel algorithmic ideas and imple- 
mentation techniques we soon realized that working with ground programs is too cum- 
bersome. In practice, for producing large enough interesting ground programs for 
benchmarking we needed to write separate programs in some other language to gen- 
erate ground logic programs. This took considerable time for each benchmark family 
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and was quite inflexible and error-prone. We realized that in order to attract users and 
to be able to attack real applications we needed to support logic program rules with 
variables. 

For handling rules with variables we decided to employ a two level architecture. 
The first phase was concerned with grounding, a process to generate a set of ground 
instances of the rules in the program so that stable models are preserved. Actual 
stable-model computation was taking place in the second model search phase on the 
program grounded in the previous one. The idea was to have a separation of concern, 
that is, be able to exploit advanced database and other such techniques in the first 
phase and novel search and pruning techniques in the other in such a way that both 
steps c ould be developed relatively independently. We released the first such system 



in 1996 Niemela' and Simons ( 1996). 



This was a major step forward in attracting users and getting closer to applica- 
tions. Such a system supporting rules with variables enabled compact and modular 
encodings of problems without any further host language. It was now also possible to 
separate the problem specification and the data providing the instance to be solved. 

Working with the system and studying potential applications made me realize that 
logic programming with the stable model semantics is very different from traditional 
logic programming implemented in various Prolog systems. These systems are an- 
swering queries by SLD resolution and producing answer substitutions as results. But 
we were using logic programs more like in a constraint programming approach where 
rules are seen as constraints on a solution set (stable model) of the program and where 
a solution is not an answer substitution but a stable model, that is, a valuation that sat- 
isfies all the rules. This is like in constraint satisfaction problems where a solution is a 
variable assignment satisfying all the constraints. I wrote down these ideas in a paper 
Logic Programs with Stable Model Semantics as a Constraint Programming Paradigm 
which was first pre sented in a work shop on Computational Aspects of Nonmonotonic 



Reasoning in 1998 Niemela ( 1998) and then appeared as an extended journal version 



in 1999 Niemela (1999). The paper emphasized, in particular, the knowledge repre- 



sentation advantages of logic programs as a constraint satisfaction framework: 

"Logic programming with the stable model semantics is put forward as 
an interesting constraint programming paradigm. It is shown that the 
paradigm embeds classical logical satisfiability but seems to provide a 
more expressive framework from a knowledge representation point of 
view." 

In 1998 we put more and more emphasis on potential applications and, in partic- 
ular, on product configuration. This made us realize that a more efficient grounder 
supporting an extended modeling language is needed. At that point another student, 
Tommi Syrjanen, with excellent implementation skills and insight on language design, 
joined the group and work on a new grounder, lparse, started. The goal was to en- 
force a tighter typing of the variables in the rules to facilitate the application of more 
advanced database techniques for grounding and the integration of built-in predicates 
and functions, for instance, for arithmetic. 

We also realized that for many applications normal logic programs were inade- 
quate not allowing compact and intuitive encodings. This led to the introduction of 
new language constructs: (i) choice rules for encoding choices instead of recursive odd 
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loops needed in normal programs and (ii) cardinality and weight constraints for typ - 
ical conditions neede d in many practical applications [Soininen and Niemela (1998); 



Niem ela et al.l (119991) . In order to fully exploit the extensions computationally Patrik 
Simons developed techniques to provide bui lt-in support for them also in the model 
search phase in the version 2 of smodels ISimonsl(ll999h . 

So in 1999 when Vladimir Lifschitz coined the term answer-set programming, the 
system that we had with lparse as the grounder and smodels version 2 as the 
model search engine offered quite promising performance. For example, for propo- 
sitional satisfiability the performance of smodels compared nicely to the best SAT 
solvers at that time (before more efficient conflict driven clause learning solvers like 
zchaff emerged). Moreover, very interesting serious application work started. For 
example, at the Helsinki University of Technology we cooperated with the product 
data management group on automated product configuration which eventually led to 
a spin-off company Variantum ( |http : / / www . variantum . com/) . Moreover, in 
Vienna the dlv project for handling disjunctive programs had started a couple years 
earlier and had already made promising progress. 



5 Conclusions 

Now, more than 12 years since ASP became a recognizable paradigm of search prob- 
lem solving, we see that the efforts of researchers in various domains: artificial intel- 
ligence, knowledge representation, nonmonotonic reasoning, satisfiability and others 
resulted in a programming formalism that is being used in a variety of areas, but prin- 
cipally in those where the modelers face the issues of defaults, frame axioms and 
other nonmonotonic phenomena. The experience of ASP programmers shows that 
these phenomena can be naturally incorporated into the practice of modeling real-life 
problems. 

We believe ASP is here to stay. It provides a venue for problem modeling, prob- 
lem description and problem solving. This does not mean that the process of devel- 
oping ASP is finished. Certainly new extensions of ASP will emerge in the future. 
Additional desiderata include: software engineering tools for testing correctness of 
implementation, integrated development environments and other tools that will speed 
up the process of the use of ASP in normal programming practice. Better grounders 
and better solvers able to work with incremental grounding only will certainly emerge. 
Similarly, new application domains will surface and bring new generations of investi- 
gators and, more importantly, users for ASP. 
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